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programmed instruction and automation 



IN BEGINNING READING* 



Trying to find research in programmed instruction for 



beginning reading materials is most frustrating. The main 



problem is that there is very little reported research. Hence, 



my plan is to tell you what I have been able to dig up and then 



make a few general comments about programming and automation in 



reading. 



♦Speech given at the annual convention of the International 
Reading Association, Seattle, May 1967. It will appear in 
Volume 12 of the Proceedings. 
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Progran'rfned instruction, since its very inception, has 
always been long on learning theory rationalizations and 
heartwarming discussions but relatively short on hard core 
data* A scholarly example of this is the current, 1967 NSSE 
Yearbook, which is entitled Programmed Instruction * ( 13 ) 

Buchanan Programmed Reading 

The biggest and best controlled study that was done was a 
study by Robert Ruddell at the University of California, Berkeley. 
(24) It was one of the U.S.O.E. sponsored first grade studies. 
In this study Ruddell used the Buchanan Program Reading series 
in six classrooms and the Sheldon basic readers in six other 
classrooms. The study also contained two other groups of class- 
rooms that were getting special supplementary linguistic mater- 
ials, but we will not concern ourselves with those* 

The Stanford Achievement Test was given to all children* 
Ruddell reports raw scores for four of the five subtests related 
to reading. They were Paragraph Meaning, Word Reading, Word 
Study Skills, and Spelling* Of the four, probably Paragraph 
Meaning is the most important as it represents the most nearly 
true-to-life reading situation wherein student reads a paragraph 
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silently and answers some questions about it. On this test, the 
132 children who had the Buchanan Programmed Reading scored 1.6 
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and the 132 children who had the Sheldon basic readers scored 1.7. 
The difference between the two is not significant and as you can 
see, they are both about normal for children near the end of the 
first year. Incidentally, these scores are just about the same 
as the other first grade projects obtained in other parts of the 
country using other basal readers, ITA, DMS, and various phonic 
and linguistic methods. 

In the Ilford Reading section of the Stanford, the programmed 
reading children scored 1.8 and the basal reading children scored 
1.7« Ruddell found this difference to be significant. I must 
hasten to add that Ruddell reported only iraw scores and I simply 
took his raw scores and followed the directions given in the 
teachers manual to convert to grade level scores. This is an 
excellent illustration of what Clark Trow was talking about when 
he pointed out the difference betweer educational significance and 
statistical significance. ( 31) Here we see a difference of one- 
tenth of a year which hardly any classroom teacher or experienced 
educator would consider significant in terms of the reading ability 
of two groups; yet, by tests of "statistical significance," it is 
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significant at the .05 level. Let me hasten to remind you that 
the statistical significance between means only tells us that 
two means that far apart could nob have occurred by chance ex- 
cept for five times in a hundred. It tells us nothing about the 
size of the difference between the two means. Classroom teachers, 
of course, are concerned with the size of the difference between 
the means; they want to know — does one method teach reading 
better than another method? 

Another section of the Stanford is the Word Study Skills 
which is a mild mixture of some phonics word attack skills test. 
Both the Programmed Reading and the basal readers scored 1.7. In 
terms of Spelling, there was the same lack of difference; namely, 
both groups scored 1.7. 

A subsample of the same population consisting of about 44 

students was given ^ome individual oral reading tests . The 

\ 

Gilmore Oral Reading Test accuracy scores were 16.6 for Programmed 
Reading and 17.7 for the Sheldon readers. On the Gilmore Oral 
rate score the Programmed Reading students scored 46.8 and the 

4 

Sheldon readers scored 51.8. Even though the differences seemed 
to favor the basal readers, there is a lack of statistical signi- 
ficance in the difference. There is also probably a lack of 
educational significance in the difference. 
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Th© suflbsainple was also given a list: of high frequency words 
prepared by Arthur Gates and the Programmed Reading children 
scored 11 *8 while the basal reading taught children scored 10.8 — 
again, a non-significant difference. A statistically significant 
difference was found on a list of phonetically regular words 
which were read orally with the programmed reading children scoring 
9.1 and the basal reading children scoring 5.4. 

In summairy, there does not seem to be much difference in 
the reading achievement of the students taught by Programmed 
Reading and students taught by the Sheldon basic readers. The 
Buchanan Programmed Reading series does emphasize the phonetic 
regularity of words and uses a kind of a phonics, or if you 
prefer, linguistics approach, and this does seem to give the 
students some advantage in terms of reading phonetically regular 
words only, but this advantage does not show up on more important 
segments of reading tests such as comprehension of paragraphs 
read silently or in the accuracy and speed of oral reading. 

(Insert Table 1 about here) 

Harry Silberroan did a rather extensive review of the research 
and related theoretical articles entitled "Reading and Related 
Verbal Learning" that appeared in the book Teachin_ct Machines and 
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Programmed Learning II published by the NBA in 1965 • (25^ ) 



As part of this article he describes onlv one oroaram evaluation 

— «* «» 



Of beginning reading that has any type of test results. This 



again is a description of the Buchanan beginning reading mater- 



ials which were used at Crittenden School in Mountainview, 



California. A remedial class of 15, first through fourth grade 



children, used the program for 25 minutes a day, five days a 



week for three weeks. They showed a mean gain on the Gates 



Reading Test of four months. Since this report has no other 



citation, presumably, it was submitted to Silberman directly by 



the publisher or the author of the materials. This type of 



report is probably loaded with most of the errors that you could 



find in any kind of educational research. First of all, it is 



unsigned and it was presumably done by the materials seller. 



Secondly, it has only 15 students in it which is too small to give 



much reliability. Third, there was no control group. Next, it 



only lasted for three weeks which is certainly not enough time 



to use a standardized reading test and measure any gain at all 



(the standard error of measurement on most achievement tests for 



groups this size would be over three months) . I do not deny that 



the Buchanan materials can teach reading. What I am saying is 



that little studies like this don't prove much. However, when 



you can get no other data, i guess you have to use what is avail- 
able. 
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Talking Typewriter 



Zkn 4 j MM X. J • . • . . 

v*«uviioi.iav.xun i:ype project nas Oeen carried 
out by O.K. Moore with his "talking typewriter.” (25) In 



case you are not familiar with this device, it is a special 
typewriter attached to something like a small computer. When 
the student presses a key, the machine says the name of the 



letter. It can also be programmed so that if the student types 
a word, the machine says the word. Moore li3:es the term "re- 
sponsive environment" in that the student is allowed to come in 
and simply hit keys at random listening to the letters. The 
environment, namely, the talking typewriter, responds to the 
child’s inquisitive little fingers and this, according to Moore, 
is the best learning situation. The ideal free choice mode, 
however, is shortly ^terminated as soon as the machine tells him 
or shows him on a visual display a certain letter to hit and he 
learns to hit the correct key because all others will be silent 
and inoperative, in this manner, the child is then taught to 
copy words and eventually sentences. 

1 have visited Moore’s laboratory in Connecticut and seen 
that children working with typewriters can, indeed, learn to 
read. However, the little boy they gave me to test who is about 
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four and reading on the third grade level also had an IQ of about 
150. I would hesitate to generalize on a sample of one, but I 

must, in all honesty, say that I have never seen any studies re- 

ported by jioore which included IQ tests. Certainly, the next 
time I saw the talking typewriter was in a Harlem kindergarten 
situation and after several weeks of instruction, the children 
had only mastered three letters of the alphabet in a phonetic- 
type reading lesson. The Harlem experiences carried on by Lessar 
Gotkin are certainly a far cry from the type of children that 
Moore likes to shew off on television and in his films. 

Gotkin did publish a smidgen of data to the effect that 

eight children who were exposed to nine lessons ranging in length 
from about 40 to 125 responses shewed gains on a letter naming 
pretest of the nine letters taught from 2.75% to 45.50%. Hence, 
there is some evidence that disadvantaged kindergarteners can 
learn slightly less than half of nine letters taught in nine 
lessons. ( ) 

Other Programmed Studies 

Along this same vein, in the demonstration-type approach 
to teaching beginning reading, James Evans has reported that he 
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taught one 3^5 year old how to read 218 short phonetic words using 
a Multi-Max teaching machine. { Sl ) Evans aided in the develop- 
ment of the program called ” Reading^ a Programmed Primer, ” pub- 
lished by Grolier. (21> 

Not all, investigators of beginning reading using programmed 
instruction believe in phonics. McNeil and Keislar used essentially 
a whole word approach on a teaching machine in which 40 everyday 
words were taught to 182 non-reading kindergarteners. (18 ) 

The study was really an attempt to see if oral responses aided 
the learning of the words and their investigation concluded that 
it was. The authors also suggested that oral responding aided 
the motivation of children of IQ*s below 100. 

A teaching machine was also used by Falconer who conducted 
a study using 8 deaf children who were about 6 and 7 years of age. 
Using the machine for about five minutes daily for about two 
weeks they learned fifteen nouns, 

Robinson, Weintraub and Smith in their monumental collection 
of research findings in reading published annually in the Reading 
Research Quarterly report only two studies using programmed in- 
struction in the past two years. ( ( 22. ) In the first 
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study, Blackman and Capobianco taught reading to 19 mentally 



retarded youngsters using a teaching machine. ( 2, ) They did 



not learn to read any better than 17 equated students in the 



control group who used traditional special class procedures 
The second study was the Ruddell study. 

Programmed Teachers 



The studies we have reported thus far use material that is 



programmed; that is, the student interacts with the material 



either in book form or on a machine with the teacher acting only 



as an overseer or, at best, a supplement to the instruction. 



However, Ellson, Barber, Engel, and Kampwerth attempted to pro— 



gram the whole tutoring situation including the untrained teacher. 



(4 ) In a little series of e9q)eriments and demonstrations. 



some 400 children were taught to read. These children included 



groups of slow learners, retarded children, as well as normal 



kindergarten and first grade readers. They report only one 



"failure." Gains tend to be reported in cumulative curves after 



the fashion of Skinner and his pecking pigeons. The authors felt 



that their programmed tutoring was most successful when it was 



used as a supplement to regular classroom teaching. 



Perhaps at least a brief description of one of Ellson *s ex- 



periment will give an idea of a type of programmed tutoring. The 
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tutor sits behind a wooden screen and holds up a word in a window. 



If the child calls off the word correctly, a light is flashed .t*. 
meaning correct, and the tutor shows the next word. If, however, 
the child does not know the word, the tutor places a picture of 
the word alongside of it. If the student can now name the word 
with the help of the picture, the tutor removes the picture and 
sees if the student can say the 'ford without having the picture 
present. If the student cannot say the word, the tutor helps him 
to say the word correctly, then a new word is shown. 

A similar type procedure of human operated teaching machine 
has also been used by Statts. ( 2^ ) Only, instead of re- 
warding the student with a flashing light, he is somewhat more 
lavish with his* reinforcement budget and hands out tokens which 
are exchangeable for toys. 

Computer Assisted Instruction 

Prom a programmed tutor to completely automating the pro- 
cesses is but a short technological step. ?ioday, the letters CAI 
standing for Computer Assisted Instruction are becoming almost as 
well known as various other trigrams such as IRA, ITA, and SOB. 
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The idea of putting tutoring, or at least the function of a 

inscliin©^ i.n iio sl Goxnpt2t^s2r Iiss Isssn witii 12 s sines st Xsssii 
1959 when Rath, Anderson, and Brainerd used a typewriter input- 
output station in the manner of a more or less traditional 
teaching machine. ( ^ ) Hence, we can say that at its simplest, 
computer assisted instruction for an individual needs simply a 
typewriter connected to a computer. Of course, the type of decision 
malcing process inside the computer can become extremely complex. 

The sinplest type of procedure would be simply to ask the student 
to respond to a question or picture:, by typing in a word and the 
computer lells him whether or not he had responded correctly. A 
slightly more complex bit of programming would not only tell him 
if he was correct, but if he was wrong — what the correct answer 
was. The next degree of complexity would be try to understand his 
wrong response, and if it was egregious enough to refer the student 
back for review or remedial work. Recently, much more complex 
decision making process, on the part of the computer, has been 
theorized and at least partially programmed by such workers as 
Stolurow, L^is and Pask, Glaser, Atkinson and Hansen, and Simon 
and Kotovsky. (11.) Atkinson and Hansen are interested in 
developing quantiitative learning models that can be used to develop 
optimal instructional sequences and thus, maximize learning. 
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Duncan Hansen in his article, "Computer Assistance with the 
Educational Process" in the December 1966 Review of Educational 
Research lists about a dozen universities that have active and 
ongoing CAI projects. (11 ) There are at least three CAI 
projects that have beginning reading as one of their major 
emphases; these are the projects at Stanford with Suppes and 

the project at the University of Pittsburgh, directed 
by Robert Glaser, and the project at Harvard, directed by Larry 
Stolurow. 

Most of the CAI projects related to reading have a good deal 
more input and output equipment than just a typewriter; for 
example, the Stanford project has for each of sixteen student's 
booths, a picture projector, a cathode ray tube, which functions 
much like a television tube, a light pen, a typewriter keyboard, 
set of earphones and a microphone. It is interesting to note 
that even the "boob tube" has been educated so that now it can 
accept feedback from the student. For exaunple, the computer can 
display three words on the tube and ask the student to underline 
the correct word which would answer a question given aurally. The 
student takes his light pen and underlines the word; then the 
computer tells him whether or not his response was correct. 
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I have not seen any results that say whether or not a 
computer can teach reading better than a teacher in a tutoring 
situation or in a whole class situation* I have, however, seen 
plenty of reports about the expense of running a computer for 
instruction* Machine rental for just the equipment is very ex- 
pensive and only feasible for research purposes* There is always 
the possibility, of course, that computers will become much 

i 

cheaper, and with time sharing which allows a number of students 



to work off one computer, plus the economical connections that can 
be made between a classroom and a central computer using just 
telephone lines, it is not inconceive^le that classrooms or at 
least remedial reading rooms will have some CAI in the not too 






distant future* 
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In the development of curriculum material, Glaser and his 
colleagues at Pittsburgh are developing a system which is known 
as IPI which stands for Individually Prescribed Instruction* They 
have broken reading down into a number of skill oriented tasks 
by an educational type of job analysis, and have used a large 
number of materials such as a number of parts of the Sullivan 
Progrcunmed Reading* At present, IPI is more of a "Systems 
Approach" which uses flow charts and a number of individually 
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assigned tasks to progress children through the reading curriculum. 
Once worked out, it is possible that a good bit of both the 
decision making for the "next step" as well as the actual 
curriculum materials such as the reading paragraphs and phonics 
sounds and symbols can be placed in the computer memory system. 

Atkinson and Hansen have also published an article in the 
recent Reading Research Quarterly describing their CAI project 
in initial reading and given samples of computer and student 
behavior. ( 1. ) 

Programmed Materials 

The publishing industry seems to have taken some formal 
notice of programmed instructional materials in reading. The 
1967 edition of Textbooks in Print has a section under Reading 
entitled "Programmed Learning." (2^) lists i e different 

sets of materials. However, the bulk of the programmed reading 
materials mentioned seem to be either the programmed reading 
materials prepared by Sullivan associates or the Lessons for Self- 
Instruction in the Basic Skills published by California Test 
Bureau. (See Figure 1) 
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Figure 1 listing the reading progrcunmed instruction materials 
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date, but is a kind of objective measure of progress in the field. 
Earlier compilation of programs in all fields have been done by 
the Center for Programmed Instruction that is now merged with 
Teachers College at Columbia University and by Carl Hendershot. 



(12 ) 

Not all programmed instruction is at one extreme or the 
other; that is, it doesn't have to have a computer and it doesn't 
have to be just a book. Some interesting materials are being 
developed that use sight and sound or just sound. For example. 
Imperial Productions, has developed a set of 40 tapes which teach 
reading skills ranging from reading readiness up to 3rd grade. ( 19) 
Each tape has an accompanying four-page worksheet. The reading 
readiness tapes tell stories and ask students to do tasks similar 
to that found in traditional reading readiness workbooks. The 
only difference, however, is that no teacher is needed; 
the tape guides as many children through as are plugged into the 
listening post. In older students, for example, the stories are 
read by the student and then comprehension questions are asked 
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orally, with the student writing the answers on his worksheet. 

After time has been allowed for the student to write his answer 
the tape tells him the correctness of his response. Needless 
to say, with only 40 short tapes to cover four years of reading 
instruction, this is intended as a supplementary program; but 
it does give some interesting thoughts to any teacher with a 
tape recorder who wishes to either purchase a prepared program 
or develop her own in conjunction with a set of printed materials. 

A slightly more elaborate system is the Aud-X device developed 
by EDL which displays words as well as reads them to the child. 

An interesting modification of the Cloze technique that the Aud-X 
system uses is to tell the students a story orally, then the 
voice leaves out a word and the word is presented visually by 
the machine. Thus, the student is given semantic clues to help 
him to read the syitibol. The Aud-X has also a set of workbooks 
which can be used in conjunction with the machine so that the 
student is interacting by following directions given by the 
machine, such as circling a yes or no or writing a word in a 
space. After allowing for the student to respond in his workbook, 
the machine can then tell the student the word and show him the 



correct word on its screen. 
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Attitudes Towards Prograromed Ins-bruction 

Teachers seem to be leary of machines and automation; if 
not, new devices in toto. Table 2 which shows the results of a 
study done by Tobias on teachers' attitudes toward progrcunmed 
instructional terms found that such terms as "teaching machine*' 
and "automated instruction” were the most disliked by teachers* 
(30) Slightly less threatening were such terms as "programmed 
text" and "programmed instruction." But the teachers really felt 
more at home with terms like "flash card," and "workbook." Though 
this study was not done on reading teachers per se, presumably it 
applies to them equally. 

(Insert Table 2 about here) 

There have been numerous studies done on students' attitudes 
toward progrsmimed instruction, though none specifically in the 
field of reading* A typical finding would be the one by McOiigan 
and Peters which surveyed some 400 elementary and secondary 
students and found that 55 per cent of their responses were 
favorable towards programmed instruction, 26 per cent were neutral 
and 19 per cent had negative reactions * ( 3^ ) 
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While the attitudes of teachers and pupils are important, 
there are forces outside the school which may be of great importance 
in the next few years* I would like to quote directly from a 
report entitled "Automation and Technology in Educatiorf' prepared 
after hearings by the Joint Economic Committee of the Congress 
of the united States: 



"Educational technology is now a major field 
of corporate research and investment. It is not only 
the business equipment manufacturers who are involved, 
but a great variety of corporations, many of them among 
the giants, ranging from steel and chemicals to publish* 
ing firms, who are directing their efforts more to the 
burgeoning education market* One witness stated: 

• The American economy was built around the 
railroads in the last half of the 19th century, 
around the automobile in the first two**thirds of 
this century, and it will be built around education 
in the balance of this century."' ( 22 ) 



This statement may seem a little strong, but one doesn*t need 
to v/alk much further than the convention floor or to read much 
more technical material than the financial pages of the newspaper 
to know that there is at least some truth in it and reading 
teachers had best be aware of this trend* 
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Conclusions 



There seems to be plenty of evidence that programmed instruc- 



t 

I 

5 *' 



I 

I 

I 









I 

I 

I 



t 

y 

& 



% 



I 



I er|c 



tion and its technological neighbors of computer assisted in- 
struction and talking typewriters can teach beginning reading* 
There is no proof, however, that it. can teach beginning reading 
any better than regular classroom teaching or human tutoring* In 
fact, in the only well controlled study we were able to find 
(Ruddell) programmed learning and basal texts came out in a dead 
heat* Thus, the classroom teacher should feel free to use as 
much programmed instruction or automated procedures as her tempera- 
ment and budget will allow* 
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TABLB 1 



PROGRAMMED READING COMPARED WITH BASAL READERS AT 

THE END OF 1st GRADE 

(Data taken from Ruddell 1965) 



Buchanan 

Group Readino Test Means Proaranuned Readina 


Sheldon 
Basic Readers 


Stanford Achievement Test 
Primary I (N-about 132 per cell) 
Grade Scores 

Paragraph Meaning 


1.6 


1.7 


Word Reading 


1.8 


1.7* 


Word Study Skills 


1.7 


1.7 


Spelling 


1.7 


1.7 


Individual Readincr Test Means 

Raw Scores (N=about 44 per cell) 
Gilmore Oral Accuracy 


16.6 


17.7 


Gilmore Oral Rate 


46.8 


51.8 


Gates Word - Oral (Words 
not selected for phonic 
regularity) 


11.8 


10.8 


Phonetically Regular Words 
Oral Reading Test 


9.1 


5.4* 



*Ruddell found raw scores with statistically significant 
differences between means at .05 level. 







TABLE 2 



« 






ATTITUDE OF 50 TEACHERS TOWARD PROGRAMED INSTRUCTION 

(Tobias 1963) 



Terms 


Mean Ratine 


Teaching Machine 


25.09 


Automated Instruction 


23.80 


Mechanized Tutor 


22.16 


Technological Terms 


24.13 


Programed Text 


30.31 


Tutor T^xt 


28.65 


Programed Instruction 


31.73 


Programing Terms 


29.94 


Flash card 


31.77 


Exercise Book 


33.33 


Workbook 


33.78 


Traditional Terms 


32.97 



(Maximum score 42) 
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FIGURE 1 



READING PROGRAMMED INSTRUCTIONAL MATERIALS LISTED IN 

TEXTBOOKS IN PRINT 



Allen, R. V« & Claryce. Language Experiences in Reading (Grades 1-2) 
Encyclopedia Britannica Press* 

Bostwick, 6racecarol«and Miles Midloch. Lessons in Self- Instruction 
in the Basic Skills (Various titles Grades 3 to High School) 
California Test Bureau. 

Carroll, Lucy. Programmed Phonics (2 books) Educational 
Publications. 

Loesel, W. G. Help Yourself to Read, Right, and Spell (2 books) 
Educational Development Corporation. Ginn 

Glassman, J. Programmed Reading . Globe 

Loretan, Joseph 0. and New York City Schools staff. Building 
... Beading Power (kit) Merrill. 

Sullivan Associates. Programmed Reading (Grades 1-3) Webster- 
McGraw-Hill • 



